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We study the thermodynamic properties of spin systems on small-world hypergraphs, obtained by 
superimposing sparse Poisson random graphs with p-spin interactions onto a one-dimensional Ising 
chain with nearest-neighbor interactions. We use replica-symmetric transfer-matrix techniques to 
derive a set of fixed-point equations describing the relevant order parameters and free energy, and 
solve them employing population dynamics. In the special case where the number of connections per 
site is of the order of the system size we are able to solve the model analytically. In the more general 
case where the number of connections is finite we determine the static and dynamic ferromagnetic- 
paramagnetic transitions using population dynamics. The results are tested against Monte-Carlo 
simulations. 
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I. INTRODUCTION 

In recent years, a large amount of work has been de- 
voted to the study of small-world networks, mainly nu- 
merical with emphasis e.g. on biophysical networks 
or social networks p| and, to a lesser extent, an- 
alytically 0,0- For recent reviews see e.g. Q- 0- By 
now, it has thus become apparent that small- world archi- 
tectures can be found in many different circumstances, 
ranging from linguistic, epidemic and social networks to 
the world- wide- web. 

Efficient modeling of real-world applications not only 
often requires a diluted random graph to describe the in- 
teraction network but, moreover, these interactions some- 
times couple fc-plets of agents. For instance, it has been 
found that the proteomic network of yeast forms a hy- 
pergraph with the proteins corresponding to vertices and 
the protein-complexes corresponding to hyperedges |13| . 
Other large metabolic networks like the one of E. coli 
have also been found to possess a small-world structure 
and as most of the reactions of metabolism are multi- 
molecular they can be represented by hypergraphs Q. 
Technical analysis of sparse hypergraphs is, however, in- 
volved even without superimposing small- world architec- 
tures. 

A convenient way to describe the statistical physics of 
this type of systems is to consider diluted random graphs 
with p-spin interactions. In this context, a ferromagnetic 
model having 3-spin interactions and finite connectivity 
has been considered recently in 0. (See also 0,0])- 

A complete description of a small-world system re- 
quires in addition local interactions. A simple example 
of the latter is the nearest-neighbor ferromagnetic Ising 
interaction. The inclusion of such local interactions can 
completely change the functioning and the dynamics of 
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such systems. It was shown in jjj, e.g., that this con- 
struction significantly enlarges the region in parameter 
space where ferromagnetism occurs. In particular, for 
any choice of the value of the average connectivity, how- 
ever small, the ferromagnetic-paramagnetic transition oc- 
curs at a finite temperature. Furthermore, a jump in the 
entropy of metastable configurations has been found 
exactly at the crossover between the small-world and the 
Poisson random graph structure due to the formation of 
disconnected clusters within the graph. 

In this work we study the thermodynamic properties 
of such a small-world hypergraph, obtained by superim- 
posing sparse Poisson random graphs with p-spin inter- 
actions onto a one-dimensional Ising chain with nearest- 
neighbor interactions. An analytic study of this model 
is non-trivial. The relevant disorder-averaged free en- 
ergy and order parameters are calculated using replica- 
symmetric transfer- matrix techniques. A set of fixed- 
point equations for the order parameter functions is de- 
rived and solved numerically with the population dynam- 
ics algorithm ^]. For p = 2 we find back some of the 
results described in , |2Ct l2l) , for p > 3 the physics is 
different. In the limit where the number of long-range 
short-cuts are of the order of the system size for each 
site we get a mean-field model for which we are able to 
solve the order parameters in a completely analytic way, 
again using transfer matrices. First-order phase transi- 
tions from the ferromagnetic to the paramagnetic phase 
are found for all values of p, along with metastable (spin- 
odal) transitions. Additionally, for p = 2 a second-order 
phase transition and a coexistence region between the two 
phases are found. 

Monte-Carlo simulations of the system employing 
Glauber dynamics allow us to find the dynamic 
(metastable) transition- lines. Very good agreement with 
the theory is found when the Ising chain interactions are 
ferromagnetic. When they are anti- ferromagnetic we find 
that the dynamics becomes very slow, indicating critical 
ing down in this region. The rest of this paper is 




FIG. 1: Schematic representation of a hypergraph of degree 3 
superimposed onto an Ising chain. Each black dot represents 
a spin, whereas each circle represents a hyperedge involving 3 
spins 



organized as follows. In Sec. [n] we define the small- world 
model. In Sec. IIII Al we derive the saddle-point equa- 
tions for the relevant order parameter function. Sec. IIII 61 
discusses the transfer-matrix analysis in the replica sym- 
metric approximation leading to a set of fixed-point equa- 
tions involving the eigenvectors. Expressions for the free 
energy and the physical order parameters are given in 
Sec. IIII CI There, we also discuss the continuous bi- 
furcations from zero magnetization. Sec. IIVI gives the 
analytic solution of the fully connected version of the 
model. In Sec. we numerically study the fixed-point 
equations and compare the results with simulations. Fi- 
nally, Sec. IVII contains the concluding remarks. 



II. THE MODEL 

Consider a system of N Ising spins <j = {ax, . . . , on), 
with <jj G { — 1,1}, arranged on a one-dimensional chain 
(<7jv+i = <j\). Two different couplings are assumed to 
be present in this system: first, nearest-neighbor interac- 
tions of uniform strength Jo and, secondly, sparse long- 
range p-spin interactions of the form Cj lt ,,, : j cr^ . . . (Xj . 
Vje G {1,2,..., N}, of uniform strength J, which can be 
described by a hypergraph of degree p. An example of 
such a system for p = 3 is shown in Fig. ^ 

The couplings Cj 1 j are independent identically dis- 
tributed random variables, for j± < j% < . . . < j p , taken 
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from the following distribution 

pf c i) = c ~ T So- i 

+ Sc . . o (1) 

The value Cj lt .„ t j = 1 indicates that the hyperedge 
formed by the p spins {aj 1 , . . . , <jj p ) is present, whereas 
Cj 1 ....j p = means that there is no such hyperedge 
present. The quantity c indicates the total number of 
hyperedges a spin a is, on average, part of 

Y. ^U-dp-l = c ( 2 ) 
i jl<---<j P -l 

In the small-world context one takes c to be a small num- 
ber of order 0(1) while c/N -> 0. 

We assume that the couplings are symmetric such that 
for any permutation ir in S p (the symmetric group of p 
elements): 

Furthermore, we exclude self-interactions and hyperedges 
of reduced degree by stating that 

Vfc ? I G {1, .. .,p] : j k = 3i => c ju ..., jp = (4) 

meaning that the hyperedge does not exist when any two 
indices are equal. 

At thermal equilibrium, such a system can be described 
by the Hamiltonian 

H(<r) = -J2<rM<r) (5) 

i 

where the local field consists of a hypergraph part and a 
chain part 

= CD ^ c iJu-J p -i (T h--- CT jp-i 
h<-"<3p-l 

+yfa-i (6) 

We want to study the thermodynamic properties of this 
network structure which follow from the free energy per 
site 

f = - lim J-fogVe-^W (7) 

where (3 = 1 /T corresponds to the inverse bath tempera- 
ture. 
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III. REPLICATED TRANSFER-MATRIX 
ANALYSIS 

A. Saddle-point equations 

We start from the free energy per spin written down in 
the replica approach [2^ 



/?/(/?) = lim lim-^log(Z") c 



(8) 



(Z n ) 



(exp(-/?£lf(o) ) (9) 

ri ...,<T" \ \ " / / C 



with a = 1, . . . , n the replica index and the average taken 
over all possible graphs c according to the distribution 
QJ, so that we obtain 



(Z n ) c = J2 exp /3J $>>?+i 

<J x ,...,0" n V i,a 

x II («pf^E^.-*^ •••<)) 

jl<---<j P \ \ a / I Cji 



(10) 



cr 1 ,...,^" 



x exp 



/ c(p-l)! v / 
\ ji<---<j P 



¥So'ji-"S, _ i) i(ii) 



where we have used the fact that iV — * oo to contract the 
average over Cj u ...,j v into an exponential. 

The next step is to insert unities 1 = J2cr ^c-Ci an d 
1 = J^t ^T,eTj where er, r are auxiliary vectors in replica 
space to arrive at 



(, *1> i E IIE^. ff i. 



^ Ti...T p fe=l 



(12) 



In this way we have effectively introduced an order 
function 



(13) 



that can be inserted in 1|12[1 in the usual way 

1 = J ' Y[dF(r)dF(r) e^X^-*^^) (14) 



to obtain 



(Z n ) 



Y[dF(r)dF(i 



exp 



INY,F(t)F(t) 



cN 



ex P — E l[F(T k )(e^^-^-l 



Tl...T p fe=l 



J] exp LSJbE ?^!-^^*) ( 15 ) 



We can then apply the saddle-point method resulting in 



log((Z n ) c ) = Extr 



F,F 
V 



■J2 P (r)F(r) 



Ti...T„ fc=l 



+ ^ lo g( E ^E'^^HE^^ 
i tr 1 ,...,*?™ 



(16) 



Derivation with respect to F(i/>) and results 
in the following self-consistent equation for the density 
F(i>): 



Fty) 



^-j(J i...(T n 


JV Ei ^(Ji.l\) 


exp 




E(Ti...(T" ex P (AE 






) 



(17) 
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In the absence of short-range bonds, i.e. Jo = 0, this 
expression factorizes over sites and can be reduced con- 
siderably. In our case, however, this is not possible and 
in order to perform the spin summations we are now re- 
quired to construct transfer matrices. 



B. Transfer- matrix analysis 

Defining the following 2" x 2™ matrix 

T(t,t[F] = exp ^Jq^V'VM 
x expje J2 n F ( T fc)( e ^ E " r? '" : 



f-i' 7 - l 



Ti...T„-i k=l 



Eq. JTJJ reads 
F(t/,) = 



AT tr (T N [F]) 



(19) 



We insert unity 1 = ^2 T &(jj,T and introduce the matrix 
QtTjTiip) = ib^CiiT ^° obtain after some algebra 



tr (T N [F]QW)) 
tr (T N [F}) 



(20) 



To proceed with the evaluation of the traces in l|2(J|) we 
remark that in the thermodynamic limit N — > oo only Ao , 
the largest eigenvalue of T[F] will contribute. Defining 



^Tcr, T {F}u(T) = X u(a) 

T 



we have that 



(21) 
(22) 

(23) 



and consequently 



Eer u{ct)v{ct) 



(24) 



So, in order to find a solution for F(t/>) we need to solve 
the equations J2U, iJUJl and 

At this point we invoke replica symmetry (RS) by as- 
suming that W S 5 n : -FX''/') = F(Tr(ip)), One way to 
fulfil this is to write as follows [l9| 



/n 



11 2cosh(/%) (25) 

Q — 1 V ' 

The density W(h) is normalised. We also assume the left 
and right eigenvectors to be replica symmetric 



/n 
dx <j)(x) TT e 
a=l 

Kvo = J d y x(y) II e 



(26) 
(27) 



This allows us to write down self-consistent equations 
for cf>(x) and x( x )- We insert Eqs. and into the 
l.h.s of Eq. 12ip and obtain after some algebra (see the 
Appendix for more details) the following closed equation 
for n — > 



\o<t>(x') = ^2 



-c mi 



x S 



x --0 



M p-1 „ "1 p 

nn dh kW(K) Uxcp(x) 

v=ik=r \ J 

M / qj p- 1 \ 

^2 atanh tanh( — ) tanh^/i^) 



fc=i 



-atanh ^tanh(/3a;) tanh(/3Jo) 



(28) 



In a similar way we derive a self-consistent equation for 
x(x) by inserting and J57J into the l.h.s. of Eq. J22J| 



Aox(x') = ]T 

/n=0 



dx x(x)S 



nn / d^^(^) 



Lu=i fc=i " 

x' — —atanh 

P 



tanh(/3J ) tanh ( (3x + ^ atanh(tanh( — ) tanh(/3/$)) 



(29) 



i/=i 
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At this point we choose the 4>{x) and x( x ) to be nor- 
malised. We remark that in the limit c — ► 0, J — > or 
p — > oo equations (|28[l and (|29[l reduce correctly to those 
of a one-dimensional Ising chain. 

Next, to find the self-consistent equation for W(h) we 
start from Eq. (|24[1 and fill in the RS-assumptions l|2tj[l 
and H27(l . Requiring that the resulting expression takes 
in the limit n — > the form of Eq. I|25|l we obtain 



W(h) = J dx dy (j)(x)x(y)S(h - x - y) 



(30) 



Finally, in order to calculate the free energy per spin we 
need to determine the largest eigenvalue Ao in the limit 
n — > 0. We start from Eq. (|2U, insert Eqs. and lf2fi|) 
to obtain 



A ° = 1 + n E L rIin / d KW(K) I dx^x) 



p=0 



/./, 



f=l fc=l 



\ £ (log (Gf (x, {/£}))) - log(2cosh((»)) 



+C(n 2 ) 



(31) 



with 



x II E (32) 

l/=l 7i...7p-i 



So Aq = 1 in the limit n — ► 0. 



C. Thermodynamics 



We can now evaluate the free energy per spin. Starting 
from |(HJ| and ifTfi)) we arrive at 



c(l-p) 



•og E 



lo g E 



E ^-T H 11 / dh l W (K) / m ~ E (tog (Gf {/£}))) - log(2 cosh((«)) (33) 



r 



which is the final result. As the elements of the adja- 
cency matrix c^...^ have been taken i.i.d. one would 
expect the degrees at each site to be Poisson distributed. 
Indeed, we see that this has come out naturally from the 
analysis and we can associate the average over the Pois- 
son probabilities in I|28I29I33|) as an average over degrees. 



The order parameters of the system under study are the 
average magnetization which reads, recalling Eq. 1251) 



^E< 



RS 



dh W(h) tanh(/3/i) 



(34) 
(35) 



and the Edwards- Anderson parameter function 

QacP : \ | — > n i n ': \ ) ■ (36) 



RS 



dhWQi) tanh 2 (/3/i) 



(37) 



We remark that due to the RS assumption m a = m for 
Vck, q a p — q for Va ^ /3, and q aa = 1. 

Next, in order to obtain the phase diagram we have to 
study the solutions of the self-consistent equations 128|) , 
(|29|) and i|3U|) . It is easily seen that the field-distributions 
(f>(x) = x(x) — W(x) — S(x) are a solution of these equa- 
tions, corresponding to the paramagnetic phase according 
to Eq. H35fl . For this solution the free energy per spin (|33f) 
reduces to 

-/3/para(/?) = -logCOsh(-' / 

+ log cosh (/3 J ) +log(2) (38) 



G 



For high temperatures, this is the only solution present. 
Following a standard procedure in finite-connectivity the- 
ory (see, e.g. 0) we discuss continuous bifurcations away 
from this solution in order to find second-order phase 
transitions. Since we are dealing with field-distributions 
this means that the fields will be narrowly distributed 
around zero so that we can expand the equations l(35|) 
and 1)37(1 . using equation i|3U|) . In order to quantify 
the difference with the deltapeak-solution we assume 
/ dh h k (f>(h) = 0(e k ) and / dh h k X (h) = 0(e k ) with 
|e| -C 1 such that 

m - + + <^> (39) 

q = 0> J dxd V 4>(x)x(y)(x + yf + 0(<?) (40) 

In order to find the transition towards non-zero magne- 
tization we look for bifurcations where the first moments 
become of order e. Introducing x = J dx x 4>(x) and 
y = J dyy x(y): ancl recalling Eqs. and we find 
the following set of self-consistent equations 

x = itanh(/?J ) +cta,nh(^-){x + y) p ~ 1 p p ~ 2 (41) 

c 

y = ytanh(/?J ) 

+ctanh(/3J )tanh(^)(x + y) p - 1 /3 p - 2 (42) 
c 

For p > 2 the second terms in the r.h.s. of these equations 
are of a higher order in e and, hence, no second-order 
bifurcations to a ferromagnetic phase are found. For p — 
2 these equations do lead to a second-order bifurcation 
at 



Again, from this we can deduce that there is no second- 
order spin-glass transition for p > 2 but for p = 2 a 
continuous bifurcation to q > 0, m = occurs at 



1 = ctanh 2 (^) cosh(2/3J ) (46) 

The p = 2 results are in agreement with those of 7], 
where it is also argued that for J, Jo > the second- 
order paramagnetic to spin-glass instability cannot occur 
as it will always be preceded by the ferromagnetic one 
when lowering the temperature. From simulation experi- 
ments we find some evidence for glassy behavior at lower 
temperatures for all p, especially for /3J < 0, as will 
be shortly discussed in Section There we also study 
first-order transitions by employing the transfer-matrix 
analysis developed in Sec. IIII AIM Bl together with pop- 
ulation dynamics. 



1 = ctanh(— ) exp(2/3J ) 



IV. THE 1 + oo DIMENSIONAL MODEL 



(43) 



in agreement with pj. 

Analogously, we can look for bifurcations to a spin- 
glass transition by expanding the second-order moments, 
assuming that x = y = 0. Introducing x 2 = J dx x 2 <p(x) 
and y 2 = Jdy y 2 x{v) we get 



x 2 = a; 2 tanh 2 (/3Jo) 

+ctanh 2 (^)(x + y) 2 (P-Vf3 p - 2 
c 

^ = ^tanh 2 03J o ) 

13 J. 



(44) 



+ctanh 2 (/3J ) tanh 2 (±— )(x + y) 2 ^" 1 ) (3 P ~ 2 



(45) 



A limiting case of the previous results is a one- 
dimensional Ising chain superimposed on a fully con- 
nected hypergraph. This model gets a mean-field charac- 
ter and can be solved analytically by using the transfer- 
matrix approach. In the sequel we denote this model by 
the 1 + oo dimensional model. 



In order to have a multispin interaction between every 
multiplet of p spins we must take c = A p_1 / (f>— 1)! (See 
e.g. equation QJ). Recalling the Hamiltonian JSJ and the 
local field 10 this leads to the following free energy per 
spin 
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Pf = Ji* ± log U exp £ . . . £ a h . . . <r* + /Wo £ ] ] (47) 

lim — log ( Tr / dmdrhexp I irh(m — — \ Cj) I exp I m p + PJq N eri(7i + i I I (48) 



N^oo N \ rr 



^im(m - <Ji)^ exp {^^-rnP + (3J ^ (7^+1^ ^ 

lim — log ( f dmdmexr> ( iNrhm + — m v | Tr [T^l 

i^N & \J F \ p J L \ 



(49) 



Here T is the transfer-matrix 



T 



— irh-\-(3 Jq 
O irh-@J 



—im—fSJo 
o irh+l3J 



(50) 



The eigenvalues A of this matrix are 
A±(m) = e^ J ° cosh{irh) 

,2/3 Jo 



± (e 2/3J ° cosh 2 (im) - 2 sinh(2/3J )) 2 (51) 



Using the fact that for ^ooTr [T N ] = A^ + A 
we write equation H49J) as 



> iV 



>oo JV 



dmdrh 

x exp ( iNrhm + — m p + N log(iA+m) 



(52) 



In the limit N — > oo, the fixed-point equation minimizing 
the free energy per spin is given by 



m = G(m), G{m) 



smk((3Jm?- 1 ) 



^sinh^/JJmP- 1 ) + e - 4 /"° 



(53) 



We remark that this equation reduces to the one pre- 
sented in 20] for p — 2. 

To find the phase diagram of this system we perform 
a bifurcation analysis. It is easy to see that m = 0, 
which describes the paramagnetic phase, always satisfies 
Eq. (|53|1 for any temperature. To find phase transitions 
away from the paramagnetic solution, we must find the 
critical parameter values for which the pair of equations 
m = G{m) and 1 = G'(m) has new m ^ solutions. 
These solutions can be created from m = (continuous 
bifurcation) or away from m — (discontinuous ones). 

With these considerations we immediately observe that 
there are no solutions for p > 2, but for p — 2 we find the 
solution 



PJ 



(54) 



To look for first-order transitions we have to find solutions 
to m = G(m) and 1 = G'(m) at m ^ 0. In this model 
this can be done analytically by introducing the auxiliary 
variable 



PJm p 



x e [— oo, oo]/{0} 



(55) 



leading to the following two equations describing the 
transition line, parametrized by x: 



PJo(x) 
pj{x) 



1 / tanh(x) sinh 2 (a;) 
4 ° g \x(p - 1) - tanh(x) 



x(p- 1) 



x{p — 1) — tanh(x) 



!(*>-!) 



(56) 
(57) 



We remark that in the limit pj — > oo, the slope of PJ / PJo 
approaches —2 and, hence, is p-independent. 

For any non-zero x we can now find a pair pj and PJq 
at which a first order phase transition occurs. The value 
of the magnetization m at that point is given by equation 
(|55|) . These phase transition lines are plotted in Fig. [21 
for several values of the degree p. 



We see that no transitions occur for even p and PJ < 0. 
Furthermore, we remark the P J symmetry for odd p, due 
to the symmetry properties of the Hamiltonian JSJ and 
© under the change of sign cr — > — <x. The ferromag- 
netic phase is situated to the right of the transition lines, 
so for odd p the paramagnetic phase is in between the 
symmetrical solid lines, for p even it lies below the corre- 
sponding solid line. For increasing p, the ferromagnetic 
region decreases. For the special case of p = 2 the param- 
agnetic and ferromagnetic phase coexist between the first 
and second-order transition lines with as tri-critical point 
PJ = V3 re 1.732, pj = - log(3)/4 w -0.275. The lat- 
ter results are in agreement with the results of |2(j and 
with those of [2l| in the case of one dimension. This anal- 
ysis serves as a limiting case of our small- world model for 
increasingly larger values of the mean connectivity per 
site c. 
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FIG. 2: Phase diagram for the 1 + oo dimensional model in 
the PJ — f3Jo plane for different p. The solid lines indicate 
first-order transitions: for /3J > 0, p = 2, 3, 4, 5 from bottom 
to top, and for j3J < 0, p — 3, 5 from top to bottom. The 
dashed line is the second-order transition line for p = 2. The 
star indicates the tri-critical point for p = 2. 



V. RESULTS FOR FINITE c. 

The main equations describing the thermodynamics of 
the small- world hypergraph for finite c are Eqs. (12811 . 12911 
and To solve these equations we use the popula- 

tion dynamics algorithm to generate field distributions 
together with Monte Carlo integration over the gener- 
ated populations in order to obtain the physical param- 
eters. The important parameters of this algorithm are 
the size of the populations and the number of iterations. 
The size of the populations has to be big enough to get 
clearly outlined distributions keeping in mind, however, 
that the computational time required for the algorithm 
to converge is linear in this parameter. In most cases we 
find that populations of 10000 fields give accurate results. 
The number of iterations per spin depends strongly on the 
physical parameters. It turns out that most of the time 
about 1000 iterations results in a reasonable accuracy. To 
calculate the ferromagnetic free energy it proves useful to 
average over several (e.g. 100) runs with different initial 
conditions. 

From the I + oo dimensional model solved analytically 
in Section \lV\ we learned already that the physics for p = 
2 versus the one for p > 3 might be very different. As a 
benchmark test for our derivations we have reproduced 
some of the results for p — 2 found in 0, 0] ■ We do not 
repeat them here but concentrate on p > 3 in the sequel. 

Starting from the paramagnetic phase and lowering the 
temperature, ferromagnetic solutions will start to appear, 
indicating a dynamical transition which appears to be 
first order. However, to check which of these solutions is 
thermodynamically stable, we need to calculate the free 



energy of both the m — and m ^ solutions. The 
former is given by (|38[l. and the latter can be calculated 
numerically from (|33|l . This leads to two special temper- 
atures: the temperature where the first m/0 solutions 
start to appear, also known as the spinodal point, dynam- 
ical transition or metastable transition, and the temper- 
ature where the ferromagnetic free energy becomes lower 
than the paramagnetic free energy, indicating the ther- 
modynamic phase transition. 



-0.34 



-0.36 - 




-0.38 - 



FIG. 3: The free energy per spin as a function of temper- 
ature for J = 1, Jo = 0, c = 3 and p — 3. The dashed 
line indicates the free energy of the m state, while the 
solid line indicates the paramagnetic free energy. The ther- 
modynamic phase transition occurs at the crossing of the two 
lines, whereas the spinodal point is the highest temperature 
for which anm/0 solution is possible. 



First, we calculate for general p the critical tempera- 
tures at which these transitions occur. They are plotted 
for the the cases p = 3, 4 for the model without chain con- 
tribution (Jo = 0) in Fig. 01, and with chain contribution 
(Jo = 0.1) in Fig. [5] Above the thermodynamic tran- 
sition lines (Tf m ) we find the paramagnetic phase, be- 
low the ferromagnetic phase. Metastable ferromagnetic 
states can be found up until the corresponding spinodal 
lines (T ms ). For all Jo we see that the critical tempera- 
ture decreases with increasing p. For Jo = a higher c 
is required to have ferromagnetic behavior. For numer- 
ical reasons we do not consider very small T or c. The 
results for p — 3 and Jo = are in agreement with the 
Tf m and T ms transition lines given in [l5j (note that our 
Hamiltonian is rescaled with a factor c). 
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FIG. 4: Critical temperatures as a function of the average 
connectivity c for the ferromagnetic-paramagnetic phase tran- 
sition (Tf m ) and the spinodal line (T ms ). Parameters are: 
p — 3, Jo = (solid); p = 4, Jo = (dotted); For all lines 
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FIG. 6: Phase transition lines in the /3 J — f3 Jo plane for p — 3 
and different connectivities c: solid lines from right to left 
c = 1,3, 10. The dotted lines are the corresponding spinodal 
lines. The dashed line is for c = oo. 



0.6 
0.5 
0.4 
0.3 
0.2 
0.1 






1 


' 1 




Tms 






/ . • ■ 't 

s . ■ ms 








T fm 




1 


,1 



FIG. 5: Critical temperatures as a function of the average 
connectivity c for the ferromagnetic-paramagnetic phase tran- 
sition (Tf m ) and the spinodal line (T ms ). Parameters are: 
p = 3, Jo = 0.1 (solid); p = 4, Jo =0.1 (dotted); For all lines 
J = 1. 



Furthermore, we search for the transition lines in the 
[3J — (3 Jo plane. These transitions between m =/= 
and to = are plotted in Fig. |B| for p — 3, (3J > 
and c = 1,3, 10 (solid lines), together with the spinodal 
lines (dotted lines) and the theoretical result for c — > oo 
(dashed line), which is solved analytically in Section llVl 
All transitions shown here are first-order. The ferromag- 



netic phase is situated to the right of the transition lines 
and increases substantially with growing c. For bigger 
values of c, the transitions approach the analytically de- 
rived c = oo result. Because p is odd, the transition 
lines for (3 J < are found by reflection symmetry with 
respect to the (3J$ axis. Just as in the p = 2 case, the 
small-world hypergraph has its ferromagnetic transition 
at finite temperatures for all non-zero values of c. Anal- 
ogously to the 1 + oo dimensional case (see fig. the 
ferromagnetic region decreases with increasing p, and dis- 
appears for p — > oo . 

Simulations have been performed for this small-world 
model with heat-bath dynamics and sequential updat- 
ing. Our results in this perspective are somewhat limited 
by the nature of the phase transition: We are dealing 
with a very sparse system undergoing a first-order phase 
transition. Metastabilities will be present (as already in- 
dicated by the presence of the spinodal lines) and cause 
slow dynamics near the thermodynamic transition line. 
This in turn causes the system to show strong hystere- 
sis effects. With these simulations we can look for the 
spinodal line by initializing the system in a fully magne- 
tized state, and looking for the temperature where order 
disappears at long times. As a typical example the re- 
sults for p = 3, c = 3 are plotted in Fig. for 10 4 spins 
and different numbers of iterations. Very good agree- 
ment with the spinodal line obtained with the population 
dynamics solution is found in the positive (3Jq region. 
When Jo is negative however we do not find satisfactory 
results. This can be explained by the opposing forces 
at work in the system (ferromagnetic graph and anti- 
ferromagnetic chain), which will only slow the dynamics 
further down. We were unable to pinpoint the thermo- 
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dynamic phase transitions with simulations due to the 
effects mentioned above. The simulations show some fur- 
ther evidence for glassy dynamics (very large spin-spin 
autocorrelation times) for lower temperatures, but a de- 
tailed discussion of such non-trivial glassy behavior is be- 
yond the scope of the present work. 




FIG. 7: Phase transition lines in the f3J — [3 Jo plane for p = 
3, c = 3. The solid line represents the spinodal line found 
by the population dynamics result. The triangles, circles and 
squares indicate the results of simulations with 10 4 spins and, 
respectively, 2000,5 x 10 4 ,5 x 10 6 iterations per spin. 



VI. DISCUSSION 



In this paper, we have studied the thermodynamics of 
small- world hypergraphs consisting of sparse Poisson ran- 
dom graphs with p-spin interactions superimposed onto a 
one-dimensional Ising chain with nearest-neighbor inter- 
actions. Using a replica-symmetric transfer-matrix anal- 
ysis and the population dynamics algorithm we have ob- 
tained the phase behavior of this system as a function 
of the short-range and long-range couplings. We find for 
p > 3 that all paramagnetic-ferromagnetic phase transi- 
tions are purely first order, in contrast with p = 2 where 
also a second order phase transition occurs. For fixed p 
and increasing connectivity c the ferromagnetic phase in- 
creases substantially and the transition line converges to 
the analytically derived result for the 1 + oo dimensional 
model. For the latter the ferromagnetic region decreases 
for growing p. Using a bifurcation analysis we see that 
again, p = 2 has also a second-order transition and the 
first-order transition occurs only for /3Jq < —0.275. 
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Appendix: self-consistent equation for <f>(x) 



In order to derive the self-consistent equation for 4>(x) we insert (|26|1 into the l.h.s. of l|21|) using l|18fl 
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= ]Texp (/3Jo]>> q t«+ c \lF{T k ){e^^"- T ?-^ -I) j f, 

T y a Ti...T p _i fc=l / 



dx <b(x)e* x 7 

/' (hi p ~ 1 

/ 

V 



fi=0 



,Ti..T„_i fc=l 



(n r \ °° f —c u 

n e [dx<t>( X )e^ j °^w e n 

\ l ' k Jfc<p-1 



p-1 



Lfe=l 



(58) 
(59) 

(60) 



In the transition to l|59|l we have used that F(tp) is normalised to separate the term e _c . We then have expanded the 
outermost of the remaining double exponential into a series. In (|60|) we have written the powers as a product over a 
new replica index v. The vectors r now have two replica indices. We also note that a poissonian factor appears. At 



this point we insert Eq. I|25|) to obtain 



ew^hm = ( n e f dx ^ 

T \ a =l 7 =±l 1 ' 

e n 

k J fe<p— 1 

nn/* 



f3xj+/3J u a 'Y 
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\ I ' k lk<p-l 
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" pP h k T k 

Y[ I dhiw{hi)j{ 



k=l 



E 



I/=l fc=l • 



k (2cosh(/3fc?)) B 



L 2cosh(/3/i£) 
dx 4>{x) 



a. j 



>< n e * 



/37(x+ J cr a ) 



a — 1 \7— ±1 / 

We now focus on the second line of the last equation 



n e 

v=l 7i...7p-i 



n e 
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= cxp(Elog(G« 
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ex P (E E \{l + scr a )\og{Gf{x,{hl}))\ 
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ex p ( U E s lo § ( G ?^ w}))) E CTq + f E log ( G ? ] 

V \s=±l / a=l s=±l / 



with (recall equation QH2JI) 



G*(x,{h" k })= E e^ x+J ^ \ J] E e^S£>^+^7i...7p- 1 c 

\7=±1 / w=l7i...7p_i 



We take the limit n — > in i|62|) and replace the last line of l|61|) with this limit 
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(E sM^ffoTO))] exp^x'|> a 



This expression is now of the form (|26[) and identifying terms leads to 



A o 0(x') = E 



v=\ fc=l 



cix 4>{x)5 



l -{ E S log(Gf (x,{^})) 



2/3 



\s=±l 



where we have used additionally that (2 cosh((3h^)) n — > 1 when n — > 0. 
This equation can be simplified further as follows 
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\7=±1 



n e 

i/=l 7i...7 P -i 

= 4 cosh (^(x + Jaa)) Yl cosh ( /3ft-i H 72---7p-ic 
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/3J 



4exp ( ~ log(cosh(/3/ir + — ) cosh(/3/i? - — )) ) cosh(/3(a; + J cr)) 
2 c c 



xj[ ex P (72...7 P -iCTatanh(tanh(/3^)tanh( — )) ) e p ^=' h ^ k 

v=l 72---7p-i 



p-1 



= C*(X, J) exp l^cratanh ^tanh(^-) tanh(/3/i£)J J 

with C(h v x , ■ ■ • , /ip_i, </) a function depending only on h", h^, ■ ■ ■ , h" x , J and (3. We finally arrive at 

«log(Gf(x,{^}))] 



2/3 



V.a=±X 



1 





atanh I tanh( — ) tanh(/3/i£) J + atanh (tanh(/3x) tanh(/3Jo)) 



fc=i 



(65) 



(66) 



In this way we have obtained the self-consistent equation l|28|l for <j)(x). The equation for xi x ) can be derived in an 
analogous way. 

From these equations we can also find the largest eigenvalue Ao- Keeping the factor of order n in (|62|l we end up 
with the following equation 



£1 = 

x5 



fi p-l 

nn/* 

J/=l fc=l J 



fe (2cosh(/3^))^ 



<ia; </>(x) 



*'-^(E slog{Gf(x,{hl}))\ exp^ 2(lo. 



■g(Gf (a, {/£}))) 



(67) 



When we integrate both sides over x' and expand the last exponential we find equation (13111 . 
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